UNIVERSITY OF SOUTHERN QUEENSLAND Interactive multimedia problem-based learning for enhancing pre-service teachers’ self-efficacy beliefs about teaching with computers: Design, development and evaluation

.......................................................................................................... II LIST OF FIGURES................................................................................................... IX LIST OF TABLES ..................................................................................................... X CHAPTER 1: BACKGROUND TO THE RESEARCH PROBLEM ...................................................... 1 1.1 Clarification of terminology and context ............................................................................... 2 1.1.1 Terminology................................................................................................................................................2 1.1.1.1 Computer, information technology and related terms ................................................................2 1.1.1.2 (Interactive) multimedia, hypermedia and hypertext..................................................................3 1.1.2 Context .........................................................................................................................................................4 1.2 Possible barriers to teaching with computers........................................................................ 5 1.2.1 The policy environment for teaching with computers .......................................................................5 1.2.2 Resources for teaching with computers.................................................................................................7 1.2.3 Are teachers teaching with computers?.................................................................................................9 1.2.4 Teaching with computers – the next generation................................................................................12 1.3 Professional education for teaching with computers: The problem to be investigated ......... 15 CHAPTER 2: LITERATURE REVIEW .............................................................................. 17 2.1 Investigations of computer-using teachers .......................................................................... 18 2.1.1 Describing teachers’ computer use.......................................................................................................18 2.1.1.1 Surveys of exemplary computer-using teachers .........................................................................19 2.1.1.2 Teachers in ICT-rich classrooms.....................................................................................................22 2.1.1.3 Other studies of computer-using teachers....................................................................................23 2.1.1.4 Pre-service and beginning teachers’ computer use ....................................................................26 2.1.2 Predicting teachers’ computer use........................................................................................................28 2.1.2.1 The work of Marcinkiewicz.............................................................................................................28 2.1.2.2 Other predictive studies of teachers’ computer use ...................................................................30 2.1.3 Making sense of teachers’ computer use.............................................................................................31 2.1.4 Does the use of ICTs change teachers? ................................................................................................33 2.1.5 Educating computer-using teachers: Summary of directions from the research ........................35 2.2 Teachers’ beliefs about teaching with ICTs........................................................................... 38 2.2.1 The nature of teachers’ beliefs ...............................................................................................................39 2.2.2 Beliefs and teacher behaviour................................................................................................................40 2.2.3 The construct of self-efficacy beliefs.....................................................................................................41 2.2.3.1 Self-efficacy beliefs for teaching .....................................................................................................42 2.2.3.2 Self-efficacy beliefs for computer use ............................................................................................44 2.2.3.3 Self-efficacy for teaching with computers ....................................................................................47 2.2.4 Changing teachers’ beliefs......................................................................................................................49 2.2.4.1 Changing self-efficacy beliefs..........................................................................................................51 2.2.4.2 Changes in self-efficacy for teaching .............................................................................................52 2.2.4.3 Changing self-efficacy for computer use ......................................................................................53 2.2.4.4 Changing self-efficacy for teaching with computers..................................................................54 2.2.5 Education for changing self-efficacy beliefs: Summary of theory and research findings..........55 2.3 Case methods in teacher education ..................................................................................... 57 2.3.1 The case for case methods in teacher education ................................................................................57 2.3.2 Relationship of cases to teacher expertise and beliefs.......................................................................59 2.3.2.1 Cases and expertise ...........................................................................................................................59 2.3.2.2 Cases and beliefs................................................................................................................................61 2.3.3 Presenting cases with media..................................................................................................................62 2.3.3.1 Interactive video cases......................................................................................................................63 2.3.3.2 CD-ROM cases ...................................................................................................................................66 2.3.3.3 Networked cases................................................................................................................................67 2.3.4 The potential of multimedia cases ........................................................................................................68 2.4 Problem-based learning ...................................................................................................... 68 2.4.1 The nature of problem-based learning.................................................................................................69 2.4.2 Background to problem-based learning ..............................................................................................70 2.4.3 Characteristics of problem-based learning .........................................................................................72 2.4.3.1 Role of the group in PBL ..................................................................................................................73 2.4.3.2 Role of the tutor in PBL ....................................................................................................................74 2.4.4 PBL in teacher education ........................................................................................................................75 2.4.5 Computer assisted PBL...........................................................................................................................76 2.4.5.1 Computer support of PBL................................................................................................................77 IMM-PBL: Design, development & evaluation vii 2.4.5.2 PBL in instructional design for IMM .............................................................................................78 2.5 Designing educational multimedia....................................................................................... 79 2.5.1 PBL as a constructivist methodology...................................................................................................80 2.5.2 Interactive multimedia and learning....................................................................................................81 2.5.3 Design of constructivist learning environments ................................................................................82 2.5.4 Interactivity in multimedia ....................................................................................................................86 2.5.5 Narrative form in multimedia ...............................................................................................................89 2.6 Principles for the design of IMM-PBL: A synthesis of the research......................................... 92 CHAPTER 3: RESEARCH QUESTIONS & METHODS.............................................................. 96 3.1 Research focus..................................................................................................................... 96 3.2 Research questions.............................................................................................................. 97 3.3 Research plan for the study ................................................................................................. 98 3.3.1 Proposed schedule of research ............................................................................................................100 3.4 Design and content validation ........................................................................................... 102 3.4.1 PBL validation ........................................................................................................................................102 3.4.2 Content validation .................................................................................................................................103 3.5 Prototype trial .................................................................................................................. 103 3.5.1 Microcomputer Utilisation in Teaching Efficacy Beliefs Instrument...........................................105 3.5.2 Attitudes to computers and self-efficacy for computer use...........................................................106 3.5.3 Pupil control ideology...........................................................................................................................107 3.5.4 Teacher efficacy ......................................................................................................................................108 3.5.5 Innovativeness........................................................................................................................................108 3.5.6 User evaluation questionnaire.............................................................................................................108 3.6 Beta evaluation ................................................................................................................. 109 3.7 Evaluation trial ................................................................................................................. 113 3.7.1 ACT and SCT ..........................................................................................................................................115 3.7.2 MUTEBI, PCI, teacher efficacy and innovativeness ........................................................................115 3.7.3 Open questions about teaching with computers .............................................................................116 3.7.4 User evaluation questionnaire.............................................................................................................116 3.7.5 Participant journals................................................................................................................................117 3.7.6 Participant interviews ...........................................................................................................................118 CHAPTER 4: IMM-PBL MATERIALS DESIGN & DEVELOPMENT............................................ 119 4.1 Funding and personnel ...................................................................................................... 119 4.2 Software development environment ................................................................................. 121 4.3 Overview of the development process ............................................................................... 123 4.4 Conceptualising scenario development and structure........................................................ 125 4.5 Representing the IMM-PBL design...................................................................................... 128 4.6 Content selection and preparation .................................................................................... 134 4.6.1 Stimulus materials .................................................................................................................................135 4.6.2 Reference materials................................................................................................................................136 4.6.3 Classroom Computing video...................................................................................................................137 4.6.4 Consultant interviews ...........................................................................................................................138 4.6.5 Consultant responses ............................................................................................................................139 4.7 User interface design ......................................................................................................... 140 4.7.1 General screen and interface design...................................................................................................141 4.7.2 The desk ...................................................................................................................................................143 4.7.3 The laptop computer .............................................................................................................................144 4.7.4 The folders...............................................................................................................................................146 4.7.5 Displaying video clips...........................................................................................................................147 4.7.6 Displaying consultant responses ........................................................................................................148 4.7.7 The help system......................................................................................................................................149 4.7.8 Use of intertitles......................................................................................................................................150 4.8 Materials assembly and programming ............................................................................... 151 4.8.1 Creating the web site.............................................................................................................................151 4.8.2 JavaScript programming.......................................................................................................................153 4.8.3 CD mastering and replication..............................................................................................................154 CHAPTER 5: RESULTS.......................................................................................... 155 5.1 The IMM-PBL materials...................................................................................................... 155 5.2 Design and content validation ........................................................................................... 155 5.2.1 PBL practitioners’ responses to the IMM-PBL materials................................................................155 5.2.2 Consultants’ perspectives on teaching with computers.................................................................158 5.2.2.1 The teachers and their working environments..........................................................................158 IMM-PBL: Design, development & evaluation viii 5.2.2.2 Analysis of the interviews .............................................................................................................160 5.2.2.3 Purpose..............................................................................................................................................161 5.2.2.4 Development ....................................................................................................................................162 5.2.2.5 Method...............................................................................................................................................165 5.2.2.6 Impact ................................................................................................................................................168 5.2.2.7 Issues..................................................................................................................................................171 5.2.2.8 Internet ..............................................................................................................................................173 5.3 Prototype trial .................................................................................................................. 175 5.3.1 Multi-instrument questionnaire..........................................................................................................175 5.3.1.1 The respondents...............................................................................................................................175 5.3.1.2 Scale reliabilities and results .........................................................................................................175 5.3.1.3 Relationships among the variables ..............................................................................................178 5.3.2 User evaluation questionnaire.............................................................................................................179 5.4 Beta evaluation ................................................................................................................. 182 5.5 Evaluation trial ................................................................................................................. 186 5.5.1 Data from the large group....................................................................................................................186 5.5.1.1 The respondents...............................................................................................................................186 5.5.1.2 Scale reliabilities and results .........................................................................................................187 5.5.1.3 Relationships among the variables ..............................................................................................189 5.5.2 Pretest-posttest comparison.................................................................................................................190 5.5.2.1 Likert scale instruments .................................................................................................................191 5.5.2.2 Open-ended questions....................................................................................................................193 5.5.3 Additional evaluative data...................................................................................................................195 5.5.3.1 User evaluation questionnaire ......................................................................................................195 5.5.3.2 Participant journals .........................................................................................................................200 5.5.3.3 Participant interviews.....................................................................................................................203 5.6 Summary of the data ......................................................................................................... 205 CHAPTER 6: DISCUSSION AND CONCLUSIONS................................................................ 206 6.1 Applying the IMM-PBL design principles............................................................................. 206 6.2 Answering the research questions ..................................................................................... 212 6.2.1 Research question 1 ...............................................................................................................................212 6.2.2 Research question 2 ...............................................................................................................................215 6.2.3 Research question 3 ...............................................................................................................................216 6.2.4 Research question 4 ...............................................................................................................................219 6.2.5 Research question 5 ...............................................................................................................................222 6.2.6 Research question 6 ...............................................................................................................................224 6.3 Conclusions ....................................................................................................................... 226 6.3.1 Design and development of IMM-PBL..............................................................................................226 6.3.2 Effects of IMM-PBL................................................................................................................................227 6.4 Recommendations for further development & research..................................................... 229 6.4.1 Development...........................................................................................................................................229 6.4.2 Research ...................................................................................................................................................230 REFERENCES .................................................................................................... 232 APPENDIX A – PBL VALIDATION............................................................................. 251 APPENDIX B – PROTOTYPE TRIAL PRE-TEST QUESTIONNAIRE............................................. 253 APPENDIX C – PROTOTYPE EVALUATION QUESTIONNAIRE................................................. 257 APPENDIX D – BETA EVALUATION QUESTIONNAIRE ........................................................ 260 APPENDIX E – MULTI-INSTRUMENT QUESTIONNAIRE ...................................................... 268 APPENDIX F – USER EVALUATION QUESTIONNAIRE......................................................... 274 APPENDIX G – PARTICIPANT JOURNAL....................................................................... 277 IMM-PBL: Design, development & evaluation